Confidence intervals for prevalence estimates from complex surveys with imperfect assays.

There are established methods for estimating disease prevalence with associated confidence intervals for complex surveys with perfect assays, or simple random sample surveys with imperfect assays. We develop and study methods for the complicated case of complex surveys with imperfect assays. The new methods use the melding method to combine gamma intervals for directly standardized rates and established adjustments for imperfect assays by estimating sensitivity and specificity. One of the new methods appears to have at least nominal coverage in all simulated scenarios. We compare our new methods to established methods in special cases (complex surveys with perfect assays or simple surveys with imperfect assays). In some simulations, our methods appear to guarantee coverage, while competing methods have much lower than nominal coverage, especially when overall prevalence is very low. In other settings, our methods are shown to have higher than nominal coverage. We apply our method to a seroprevalence survey of SARS-CoV-2 in undiagnosed adults in the United States between May and July 2020.

Estimation of vaccine efficacy for variants that emerge after the placebo group is vaccinated.

SARS-CoV-2 continues to evolve and the vaccine efficacy against variants is challenging to estimate. It is now common in phase III vaccine trials to provide vaccine to those randomized to placebo once efficacy has been demonstrated, precluding a direct assessment of placebo controlled vaccine efficacy after placebo vaccination. In this work, we extend methods developed for estimating vaccine efficacy post placebo vaccination to allow variant specific time varying vaccine efficacy, where time is measured since vaccination. The key idea is to infer counterfactual strain specific placebo case counts by using surveillance data that provide the proportions of the different strains. This blending of clinical trial and observational data allows estimation of strain-specific time varying vaccine efficacy, or sieve effects, including for strains that emerge after placebo vaccination. The key requirements are that the surveillance strain distribution accurately reflects the strain distribution for a placebo group throughout follow-up after placebo group vaccination, and that at least one strain is present before and after placebo vaccination. For illustration, we develop a Poisson approach for an idealized design under a rare disease assumption and then use a proportional hazards model to address staggered entry, staggered crossover, and smoothly varying strain specific vaccine efficacy. We evaluate these methods by theoretical work and simulations, and demonstrate that useful estimation of the efficacy profile is possible for strains that emerge after vaccination of the placebo group. An important principle is to incorporate sensitivity analyses to guard against misspecification of the strain distribution.

Vaccine efficacy at a point in time.

Vaccine trials are generally designed to assess efficacy on clinical disease. The vaccine effect on infection, while important both as a proxy for transmission and to describe a vaccine's entire effects, requires frequent (e.g., twice a week) longitudinal sampling to capture all infections. Such sampling may not always be feasible. A logistically easy approach is to collect a sample to test for infection at a regularly scheduled visit. Such point or cross-sectional sampling does not permit estimation of classic vaccine efficacy on infection, as long duration infections are sampled with higher probability. Building on work by Rinta-Kokko and others (2009) and Lipsitch and Kahn (2021), we evaluate proxies of the vaccine effect on transmission at a point in time; the vaccine efficacy on prevalent infection and on prevalent viral load, VE$_{\rm PI}$ and VE$_{\rm PVL}$, respectively. Longer infections with higher viral loads should have more transmission potential and prevalent vaccine efficacy naturally captures this aspect. We demonstrate how these parameters obtain from an underlying proportional hazards model for infection and allow for waning efficacy on infection, duration, and viral load. We estimate these parameters based on regression models with either repeated cross-sectional sampling or frequent longitudinal sampling. We evaluate the methods by simulation and analyze a phase III vaccine trial with polymerase chain reaction (PCR) cross-sectional sampling for subclinical infection.

Undiagnosed SARS-CoV-2 seropositivity during the first 6 months of the COVID-19 pandemic in the United States.

Asymptomatic SARS-CoV-2 infection and delayed implementation of diagnostics have led to poorly defined viral prevalence rates in the United States and elsewhere. To address this, we analyzed seropositivity in 9089 adults in the United States who had not been diagnosed previously with COVID-19. Individuals with characteristics that reflected the U.S. population (n = 27,716) were selected by quota sampling from 462,949 volunteers. Enrolled participants (n = 11,382) provided medical, geographic, demographic, and socioeconomic information and dried blood samples. Survey questions coincident with the Behavioral Risk Factor Surveillance System survey, a large probability-based national survey, were used to adjust for selection bias. Most blood samples (88.7%) were collected between 10 May and 31 July 2020 and were processed using ELISA to measure seropositivity (IgG and IgM antibodies against SARS-CoV-2 spike protein and the spike protein receptor binding domain). The overall weighted undiagnosed seropositivity estimate was 4.6% (95% CI, 2.6 to 6.5%), with race, age, sex, ethnicity, and urban/rural subgroup estimates ranging from 1.1% to 14.2%. The highest seropositivity estimates were in African American participants; younger, female, and Hispanic participants; and residents of urban centers. These data indicate that there were 4.8 undiagnosed SARS-CoV-2 infections for every diagnosed case of COVID-19, and an estimated 16.8 million infections were undiagnosed by mid-July 2020 in the United States.

A Deferred-Vaccination Design to Assess Durability of COVID-19 Vaccine Effect After the Placebo Group Is Vaccinated.

Multiple candidate vaccines to prevent COVID-19 have entered large-scale phase 3 placebo-controlled randomized clinical trials, and several have demonstrated substantial short-term efficacy. At some point after demonstration of substantial efficacy, placebo recipients should be offered the efficacious vaccine from their trial, which will occur before longer-term efficacy and safety are known. The absence of a placebo group could compromise assessment of longer-term vaccine effects. However, by continuing follow-up after vaccination of the placebo group, this study shows that placebo-controlled vaccine efficacy can be mathematically derived by assuming that the benefit of vaccination over time has the same profile for the original vaccine recipients and the original placebo recipients after their vaccination. Although this derivation provides less precise estimates than would be obtained by a standard trial where the placebo group remains unvaccinated, this proposed approach allows estimation of longer-term effect, including durability of vaccine efficacy and whether the vaccine eventually becomes harmful for some. Deferred vaccination, if done open-label, may lead to riskier behavior in the unblinded original vaccine group, confounding estimates of long-term vaccine efficacy. Hence, deferred vaccination via blinded crossover, where the vaccine group receives placebo and vice versa, would be the preferred way to assess vaccine durability and potential delayed harm. Deferred vaccination allows placebo recipients timely access to the vaccine when it would no longer be proper to maintain them on placebo, yet still allows important insights about immunologic and clinical effectiveness over time.

Standardization of ELISA protocols for serosurveys of the SARS-CoV-2 pandemic using clinical and at-home blood sampling.

The extent of SARS-CoV-2 infection throughout the United States population is currently unknown. High quality serology is key to avoiding medically costly diagnostic errors, as well as to assuring properly informed public health decisions. Here, we present an optimized ELISA-based serology protocol, from antigen production to data analyses, that helps define thresholds for IgG and IgM seropositivity with high specificities. Validation of this protocol is performed using traditionally collected serum as well as dried blood on mail-in blood sampling kits. Archival (pre-2019) samples are used as negative controls, and convalescent, PCR-diagnosed COVID-19 patient samples serve as positive controls. Using this protocol, minimal cross-reactivity is observed for the spike proteins of MERS, SARS1, OC43 and HKU1 viruses, and no cross reactivity is observed with anti-influenza A H1N1 HAI. Our protocol may thus help provide standardized, population-based data on the extent of SARS-CoV-2 seropositivity, immunity and infection.

Clinical Endpoints for Evaluating Efficacy in COVID-19 Vaccine Trials.

Several vaccine candidates to protect against severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection or coronavirus disease 2019 (COVID-19) have entered or will soon enter large-scale, phase 3, placebo-controlled randomized clinical trials. To facilitate harmonized evaluation and comparison of the efficacy of these vaccines, a general set of clinical endpoints is proposed, along with considerations to guide the selection of the primary endpoints on the basis of clinical and statistical reasoning. The plausibility that vaccine protection against symptomatic COVID-19 could be accompanied by a shift toward more SARS-CoV-2 infections that are asymptomatic is highlighted, as well as the potential implications of such a shift.